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PREFACE 



The nursing and dental hygiene Program Criteria Selection Committee 

• ■ V , 

and' the Board of Trustees requested that the administration do an evalu- 
ation of the nursing and dental hygiene selection procedures. The evalu- 
ation .has been separated into two components. This report Is part one 
which Is a preliminary Evaluation of the structured interview Instrument 
used during the Spring of 1975 as a tool for the selection of the 1975-76 
first year nursing and dental hygiene classes. \ 

'The secon^ part of the evaluation will be an analysis of the avail- 
able data for graduates and withdrawals for both the nursing and^ dental ' 
hygiene programs. A cursory examination of the data indicates that 
there will be Ihsufficient data for a meaningful predictive study. Incor 
porated into tho^ second report will be a summary <of JCCC research and 
recommendations concerning data collection and a recommended procedure 
for incorporating the^e data into the minual selection process/ 

Dr. Diana Kelley had a major role in the early development: of this 
report. ; / " 



Elaine L . Tatham 
Director of Institiitional Research 
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I.. BACKGROUND-p 

E ^oArd Action 

In a report made to the Board of Trustees during December 1974, the 
Fsogram Criteria Selection Committee emphasized the potential value of an 
Interview procedure for the evaluation of personal characteristics and 
relevant past experience of applicants to the nursing and dental hygiene 
programs. The committee received Board approval of the recommendation 
for inclusion of the interview as an integral part of the selection process. 
The committee also recommended and received approval for the employment of 

4 

a consultant to the College whcyse goals wejre the development of the inter- 

. > 

view instruments and a video tape training package for the interviewers. 

<? 

the committee further reicommended and received approval for the Office of 
Institutional Research to conduct an evaluation of the reliability and the 
validity of the structured interview instruments. 
De\^ielopment of the Interview Instruments^ 

The instrument^ were developed by the consultant in cooperation with 
^members of the nursing and dental hygiene staff. The consultant met with 
staff members of each program twice. At these meetings, the staff provided 
the consultant with information concerning the characteristics deemed Impor- 
tant for nutsing or dental hygiene and assisted in the refinement of 
questions designed to ^reveal these characteristics. 

Four separate interview instruments were developed - two for dental hygiene 
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and two^ for nursing. For each program, qne interview instrument was designed to 
• I 

be adminfErterel by a professional staff member of that program and the^'other instru- 
men't to be administered by other non-program professional staff members. The 
"program staff" nursing and dental hygiene forms were quite similar and consisted 

' i 9 ♦ . 



of eleven separate sections. The "other^ staff" forms for nursing and dental 
hygiene were- also similar and consisted of ten separate sections. Four sections 
were common to both the "program^staf f " and "other staff" forms. Each 
section consisted of a description of a ^charactqrlstlc and sev^eral optional 
questions designed to a^s^s that characteristic. A copy of the Interview ^ 
Instrumiint designed for nursing staff Interviewers Is presented In Appendix B. 

^ IlC^IilTERVIEW METHODS ^ ^ 

\ ' • ^ 

I.ntervl ewers 

^ The eleven member,8 of the nursing staff and eleven other professional 
staff (e.g., basic science, social- science or administrative staff) served as 
Interviewers for applicants to the nursing program. The six members of the 
dental hygiene staff and six other professional staff served as regular Inter- 
viewers for applicants to the dental hygiene program. Due to the unexpected 
absence of a regular Interviewer, an additional staff member was asked to 
Intervlew^Qae applicant to the dental hygiene program. ' 

V 

Interviewees 

Eighty-two applicants were Interviewed for the nursing program and thirty- 
foul: were Interviewed for the dental hygiene program. All applicants Inter- 
viewed had met- the minimum academic criteria fOr acceptance to the progromso 
Interview Procedure ' ' 

Each applicant was Interviewed twice - anp^ by a staff member of the 
program to which application was made and once by another staff member^ Twenty 
minutes were ^Hotted for the completion of ^ach Interview. For the(p<nivenlence 
of the applicant, an attempt was made to schedule the two Interviews Ai con- 
secutive half hour Intervals. The program ^^^f Interviewers rated the appll- 

r. ■ ' 
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cant on each of the eleven separate char/acterlstlcs from 1 (well below ave;- 
rage)^ to 5 (well above average). Thus, 55 was the maximum number of points 
possible on the pafogram stafi Interview form. The other staff Interviewers 
rated the applicant on each of ten separate characteristics from 1 (well be- » 
low average) to 5 (well above average). Thus, 50 was the maximum number of 
points possible' on ^he other staff Interview form. 

Interviewers were also asked «to {provide a percentile rating for each 
applicant Interviewed and to make a recommendation regarding the degree of 
acceptability of the applicant. The score obtained on each characteristic, 
the sum of these scores (the total Item score), the percentile rating and 
the acceptability rating were recorded by the Interviewer on a standard form 
for use by the selection committee. A qopy of this form Is presented In 
Appendix C. 

Use of Interview Rating In Applicant Selection 

^ The percentile rating and alcceptablllty rating were requested from 'the 
Interviewers for rftgearch purposes only. The total Item scores given by each' 
of the two Interviewers for a given applicant were summed by the selection com 
mlttee and used to rank thp applicants. Thus, 105 was the maximum number of 
summed points an applicant could dbtaln on the Interview. Johnson County rcol 
dents were given preference over other applicants by adding ten points . 
Admission to the program began with those Ind^ldualo^ who had the largest num- 
ber of points. 

^III. EVALUATION METHODS ' * 

Interviewer OplnlonnalrO 

An oplnlonnalre developed by><hG Office of Institutional Research was 
sent by campus mall to each of thb\3^ staff members serving as Interviewers. 
The Instrument wSs designed to obtain Information from the Interviewers regard 
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' f Infif' their opinion of the effectiveness of Alte interview tool and related 

scoring procedures. The interviewers were asked to make reconninqndatlons far 
ijaprovement of the interview instrument and thfe intea^view traiiilng tape.. 
A copy of the interviewer oplnionnaire is included in Appendix D. 
Analysis of Interview Data * . 

. The data analyses for the 'nursing applicants ahd the dental hy|ieno 
applicants were done separately. The data analyses compared the rating given 
by the "program ot^ff" interviewers to the ratings given by the "other staff" 
♦ ^interviewers for each of the three varia^J^les (total* item score, pei;cent±le 
rating, acceptability rating). The ratings were examined for interrater 
agreement and interrater reliability. Interrater agreement repreoento the 
extent, to which different raters make the same judginents about ^ach subject. ^ 
'Interrater reliability, however, repreoento the degree to which the relation- ; 
ship o*f one subject to another subject io the same for different raters 
even t;hough the ratero may use different numbers to express the^ relationship . 
^ The thxA^ types of data onaJLyoeo (group moan comparisons, correlations and 
croos-cabulationo) ouramari^ed below i weret used to evaluate the Interview 
instruments with respect' to interrater reliability and interrater agreement. 

Group mean compariaqna - The average total item 'score was found for all 
interviewdd applicants uoing both the ratings given by the "program oth££**^ 
• interviewees and' the "other otaff" interviewers. The pumber of items for ' 
the two forms was unequal* Total item ocoi^eG could range from II to 55* on the 
"program staff" interview farm hnd from 10 to 50 on the "other staff" form. 
, For comparison purposes, therefore, the Average total item score was divlde-d 
by the numb^^r of items to determine the- average single item score. In addition, 
the average percentile ratingo and acceptability ratings assigned the. total 
applicant group were computed ooing the ratingo given by the^rogram staff" 

9^- • . 1.^ 



.and^^'other staff" interviewers.. For purposes of computation, the acceptability 

* ■ ■* ■ 

ratings from unacceptable through outstanding were assigned the tittmbers 1 

' , 

through 5. The t^ test fdr dependent samples was used for all of these com-, 
parlsons as a measure of interrater agreement between the mean ratings given 
by the- "program; .staTf"* interviewets and the, mean ratings given by the ".other 
staff" interviewets. 

The averages >'^or the total item score, single item score, percentile 
rating and acceptability rating assigned by the "program staff" .and "other 
staff" intervie\(nars were also computed for subgroups of the total applicant 
group.. Nursing applicants were grouped according to those recommended by the 
selection committee for acceptance. (N«40) , alternate status (N«15) and rejected 
status (N=27). Because of the smaller number of applicants to dental hygiene, 
two groups were formed - those recommended by the se^ectiqn committ^ for 
acceptance (N-20) and all others , (alternates and rejected, N»14X. For each 

of the four groups of interviewers, the t^ test for independent samples was 

r - 

used to compare the mean ratings of subgroups. 

Correlations - The two total item scores, two percentile ratings and 

two acceptability ra^|igs assigned each applicant were statistically analyzed 

to determine the level of agreement between "program staff" and "other staff" 

interviewers concerning the relative ^tanding of the applicant. For each of 

the three pairs of measures, ratings 'given by the "program staff" interviewers 

were plotted versus ratings given by the "other stafx" interviewers. For all 

three rating variables, the Pearson jr waa^ used as a i4ea^\^e of interrater 

reliability. ^ 

> 

JThe same correlation analyses of the two total item scores, two percentile 
ratings an(^ two acceptability ratings given each applicant by the program 'and 
other staff interviewers were also completed for each of the subgroups described 
in the preceding section. on group mean comparisons. 

• ■ 13 



Cross-tabulations - Cross tabulations were completed to compare the ^ 
total Item scores with the acceptability ratings. For each of several total 
Item score ranges, the frequency for each of the five acceptability ratings 
was* computed. * . 

In*addltlon, the frequency and percentage of total Item scores given by 
individual Interviewers In each of several total Item score ranges were found. 
It was of Interest 'to know whether Individual Interviewers tended to give a 
majority of very high or very low ratings or whether ratings tended to be dis- 
tributed across the range of possible ratings. 

- IV. EVALUATION RESULTS - INTERVIEWER OPINIONNAIRE 

Twenty-two or 65% of the thirty-four Interviewers completed and returned 
the oplnlonnaire. to the Office of Institutional Research. Responses made to 
questions one through six and question nine haye been categorized and are pre- 
sented In Table 1. Comments made In response to questions seven, eight and 
'ten through twelve have been Included In the summary of findings which follows. 
Time for Interview 

Seventy-seven percent of the Interviewers felt that 20 minutes was suf- 
ficient time for completion of the Interview. Twenty-three percent of the res- 
pondents preferred to have 30 to 40 minutes for completion of the Interview. 
Comments made Iti rtoponse to this question Indicated that some applicants were 
late fpr second Interview appointments because the first Interview had extend- 
ed over the 20 minute limit. 
Descriptions of Personal Characteristics 

Seventy-two percent of the Interviewers felt that the descriptions o| the 
characteristics to be assesssed were sufficient. Descrlptidhs which were 
considered somewhat Insufficient typically Included abstract 'Characteristics 
(ethics, social conscience and empathy* Interpersonal Integrity) and personal 
appearance » 14 

>r 6 



Usefulness of Questions In DJ.gcrlmlnatlng App-11 cants 

Fifty-four percent of the Interviewers felt the questions provided' on 
the Interview Instrument were usefvil In discriminating between applicants In 
terms of the applicant's potential for nursing or dental hygiene. Twenty- 
three percent of the interviewers expressed doubts about the ef f ectlveiiess of 
questions in one or more of the following areas: personal integrity and ma- 
turity, Interests, communication skills. Job experience and personal appearance. 
Range of Ratings for Personal Characteristics 

Eighty-six percent of the interviewers were satisfied with the range of 
five possible item ratings (from well below average to well above average) 
and iild not recommend expansion of the range of 'ratings. However, comments 
made in response to this question indicated a desire on the part of some inter- 
viewers for rating guidelines. For example, what leyel of a g:lven Characteristic 
may be considered "average" as opposed to "above average," etc. 
Flexibility of Interview Instrument 

The majority of interviewers were pleased with the flexibility of the in- 
strument. Eighty-six pe;rcent felt that the interview would not be Improved 
by restricting the number of optional questions for each characteristic. 
Eighty-six percent felt that the interview would not be Improved by requiring 
that all interviewers ask the same question to assess a given characteristic. 
Pertinent comments indicated a need for the "program staff" an^ 'pother staff" 
interviewers to Jlscuss the characteristics to be assessed in term^ of their 
application to nursing and dental hygiene. Again, the need was expressed 
for rating guidelines or some method of standardizing the ratings. 
Overall Impression of Interview Instrumen t 

Seventy-seven percent of the interviewers had a favorable overall impres- 
sion of the interview Instrument. Unfavorable comments tended to emphasize 
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an Intex^l^w^r ' 8 personal belief that the interview process^as ess^tlally 
a*mattar of sut^jectlve judgment, 6t was npn-dlscrlmlnatlye. In addition, th*e 

, / ^ r 

suggestion was made that "program staff" anB "other- st^ff" ratings be some- 

how reconciled. , y . 

J 

Most Favorable Aspects of Interview Inst:r\iment * / 



Aspects of the structured Interview Jmstrunfent/ which most favorably Im- 
pressed the Interviewers and the number of respox^oents Indicating each were 
as follows: 

Flexibility of Instrument Including ll/t of optional questions. (n=4) 
. Structured Interview to assess the sape characteristics for ail ap- 
plicants (n « 4) 
. Section of Instrument assessing applicant's Int^irestis (n » 3) 
• Standardized rating forms which may/provide an applicant profile 
(n « 2) 

. Scheduling of Interviews for conv^lence of Interviewers and suf- 
ficient time allotted for completion of Interview (n « 2) 
. Descriptions of charactex'lstlcs to be assessed (n. « 1) 
. Comprehensive nature of Instrument (n » 1) 

Most Disliked Aspects of Interview Instrument 

p — -—j ^7 

Aspects of the structured Intejrvlew Instrument most disliked by the 
Interviewers and the^number of rea|>ondents Indicating each were as follows: 

, . The percentile rankings (n A" ^) * - 

. Inadequate definition of lor questions about abstract characteristic^ 
(e.g., personal Integrity and maturity, self-lnslght and self-concept, 
social conscience and empathy, ethics. Intelligence; n « 6) 

. Inadequate notice of s^nediiled Interview or too limited time for 
Interview (n « 2) 

. Section pertaining to/high school experiences (not applicable to all 
interviewees ; n ■ 1) 

. Some characteristics/ of different value (e.g., intelligence vs. ap- 
pearance, yet all were given same weight; n =» 1) 

. Inadequate understanding of profession to permit fair evaluation of 
applicants to program (n =» 1) 

Interview draining Tape 

Few comments were made in response to questions concerning the inter- 
view training tape. No recommendations were made to delete any aspects of 
the tape. Suggestions for additions to or Improvement of the tape Included 
the following: 



• Indicate methods which may be used to assess .abstract qualities 
(e.g., ethics. Integrity) In a conCr^e way. 

• Include methods of explaining the purpose of the Interview and the 
expected length of the Interview to the candidate. 

• Include guidelines for making rating decisions and show examples of 
rating. ' * ► * ' 

• Review other common Interviewing errors and how and why to avoid them. 
The examples of erroirs already Included In the tape were considered 
toro blat^t. - 4 

V. EVALUATION RESULTS - NURSING APPLICANT RATINGS 
The frequency and percentage of ratings given by nursing staff Inter- 
viewers In each of several total Item score ranges ^re given In Table 2, The 
same Information Is presented for the non-nursing staff Interviewers In Table 4. 
The frequency and percentage for each of the five apceptablllty ratings 
given by nursing and non-nursing interviewers are presented in Tables 3 
and 5 respectively. Some of the major results concerning the distribution 
of ratings received by applicants Include the following: . 

• Approximately 60 percent of the applicants received at least 80 per- ^ 
cent of the, maximum number of possible points from each group of In- 
terviewers (nursing staff and non-nursing staff). 

. Sixty-four percent of the applicants were rated either obviously ac- 
ceptable or outstanding by the nursing staff Interviewers* The non- 
nursing staff Interview's gave the same^ ratings to 69 percent of 
the applicants. 

• The most commonly expressed opinion concerning the acceptability of 
applicants was "obviously afcceptable. " The nursing staff Interviewers 
rated 45.7 percent of the applicants In. this category while the non- 
nursing staff gave the same rating to 53.1 percent of . the applicants. 

. Percentile ratings given by a majority of Interviewers were high. 
Approximately 80 percent of the applicants were ranked at the 75th 
percentile or higher by each group of Interviewers (nursing staff 
and non-nursing staff)* 

Interrater Agreement 

The means for the total Item score, sliigle Item score, percentile rat- 
ing and acceptability r&tlng given the applicants by the nursing and non- 
nursing staff Interviewers are presented In Table 6. 



■/ 

The mean ratings given by the nursing dtaff were similar, to the mean 
ratings given by the fion-nursing staff interviewers on all three rating^ 
variables, (total score adjusted for difference in number of items, peircentile 
rating^ acceptaMlity rating). The interrater agreement was evidenced by 
a non-signifd(.pant t^ (p>*10) for each comparison of the means for all applicants 
Applicantr Subgroup Mean Comparisons 

For the purpose of ranking applicants, the selection committee summed 
the total item score given each applicant by the nursing staff and non-nursing 
staff interviewers. The maximum total possible was 105. Although ten points 
was added for all Johnson County residents, this bonus was not included 
in the data analysies. The average summed scores for the rejected, alternate 
and accepted groups were 73.66, 86.06, and 93.43, respectively. The average 

a 

for ^1 applicants was 85.57. 

On^^th^ average, the nursing staff ratings significantly (p<.05) differ- 
entiated ^he accepted applicants from the alternates with respect to total 
item score, but not with respect to percentile or acceptability ratings. 
The pursing staff ratings significantly (p<.01) differentiated the alternates 
from^the rejected on all three variables (total vitem score, percentile rating, 
acceptability rating) . 

The non-nursing staff ratings significantly (p<.05) differentiated the 
accepted applicants from the alternates with respect to total item score and 
acceptability rating. At the 0.10 level^ of significance, the two groups were 
also differentiated with respect to percentile rating. The non-nursing staff 
interviewer ratings significantly (p<.05) differentiated the group of 
altema(;es from those rejected with respect to all three variables (totaj. 

V. 

item score, percentile rating, acceptability rating). The. dispe rsion for the 

I 

alternates on the acceptability rating was greater for the nursing staff 
interviewers than for the non-nursing staff interviewers. This is one reason 

10 j^s 
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why the mean differ^ce for the acceptability rating was significant for the 
non-nursing staff interviewers but no^ for the nursing staff interviewers when 
accepted and. qj-temate applicants were compared, • 
Interrater Reliability 

— ^ ^ 

The matrix of correlation coefficients for the all applicant group Is 

/^■"p^ea^ted In Table 7. The analysis revealed low but significant (p< .01) 

positive relationships between the ratings by nursing staff Inteirviewers 

and non-nursing' staff Interviewers on all three variables (total Item score, 

** 

percentile rating, acceptability rating).^ Therefor^, for each of these three 

ratings, if applicant A received a higher rating from a nursing staff Inter- 

viewer than applicant B, then applicant A tended to receive A higher rating 

from a non-nursing staff Interviewer than applicant Figures 1, 2 and 3^ 

respectively, present the relationships for total Item scores, percentile 

ratings and acceptability ratings, ^ ^ 
A pplicant Sub)group Correlations 

The correlation coefficient matrices for each of the three nursing subgroups 
are presented in Tables 8, 9, and 10. The dispersion of total item scores for 
all applicants (presented in Figure U suggests that if the accepted, alternate 
and rejected 3ub-groups were analyzed separately, a non-significant or even 
a significant negative coi(rrelation between ratings assigned by nursing staff 
and non-nursing staff interviewers might be revealed. For the accepted group 
and .for the alternate group, the analysis revealed a significant (p<.OI) negative 
relationship between the total Item score assign^ by the nursing staff inter- 
viewer atid the corresponding score assigned by the non-nursing staff interviewer. 
Thus, there was a tendency for nursing staff and non-nursing staff interviewers 
to disagree on the standing of an accepted applicant relative to other accepted 
applicants. Within the accepted group, a low negative but not significant (p>.05) 
relationship was found for the percentile and acceptability ratings. 

Similar results were obtained for the alternate sub-group. More specifically, 

11 lii 



there was a significant negative relationship between total scores given by 
nursing staff and non-nursing Btaff interviewers^ For the percentile and 
^ acceptability ratings, there was a low negative but not significant (p>.05) 
relationship between the nursing and non-DursIng interviewed. Agaln^ these 
nel^^ti've correlations Suggest some disagreement between the nursing and non*' 
nursing interviewers regarding the relative standing of applicants within 
the sub-groups* 

For the rejected sub-group the analyses revealed a significant (p< ,05) • 
positive relationship between the acceptability ratings assigned by nursing 
staff Interviewers and non-nursing staff interviewers. This relationship, 
which Is shown in Figure 3, suggests a^endency for nursing and non-nu?:slng 
staff Interviewers to agree on the relative standing of a rejected applicant 
relative to other rejected applicants. There was lack of agreement, however, 
on total Item scores and percentile- ratings.^-- 
Total Score Distribution for Individual Interviewers . 

Typically, total Item scores received by different applicants from the 
same Interviewer were somewhat distributed across the range of possible total 
item scores. This suggests that the Instrument did provide some degree of^ 
discrimination between applicants. However, two nursing interviewers Und one 
* non-nursing Interviewer gave total item scores within the $am^^ two point range 
to more than 50% of the applicants they Intervleved. For ex^ple, one 
nursing .staff interviewer assigned five of the eight applicants interviewed 
a score between 53 and 55. 

Relationship of Total Score to Acceptability Rating 

The relationship of the total item score received by the applicant to 
the opinion of the interviewer regarding the acceptability of the same ap- 
plicant Is presented'^^ln Table 11 fpr the nuvslng Interviewers and Table 12 
for the non-nursing Interviewers. 
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Overall, as the total Item score received by an applicant Increased, Vhe 
acceptability ratings of the applicant increased. The correlation coefficients 
In Table 7 for total item scores with acceptability ratings/ weve .79 and .82 
for the nursing and non-nursing Intervlewars , re8pect]gfely\ These, correlations 
were significant at the ,01 level. As revealed In Tables II and 12, however,^ 
there was some degree of overlap and inconsistency in the acceptability ratings. 
The majority of this overlap occurred beftween the possibly, probably and 



obviously acceptable categories, ^^n^^^^^^case of nursing staff inte^iewers, 

for example, of the 20 applicants receiving total item scares in the 38 to 43 

range, two were rated as po^slj^ly acceptable, 14 were rated as probably 

acceptable and four were rated as obviously acceptable. 

VI. EVALUATION RESULTS - DENTAL HYGIENE APPLICANT 

RATINGS 

The frequency and percentage of ratings given by dental hygiene staff 

Interviewers and non-dental hygiene staff interviewers .*are presented in 

Tables \^^^d 15 respectively. The frequency and x^rcentage for each of the 

five acceptability ratings given by these two groupa^f interviewers are 

presented in Tablefe '14 and 16. Some of the major results concerning tl\e 

distribution of ratings received by applicants include the following: 

, ^ . Approximately 60 percent of the applicants received at least 80 
percent of the maximum number of possible points (55) from the 
dental hygiene interviewers. From the non-dental hygiene staff, 
approximately 70 percent of the applicants received at least 80 
percent of the maximum number of possible points (50). 

. Fifty-nine percent of the applicants were rated either obviously 

I acceptable or outstanding by the dental hygiene staff interv^^'ewers. 

I The non-dental hygiene staff interviewers gave the same ratitigs 

> to 68 percent of the applicants. ^ 

• The most commonly expressed opinion concerning the acceptability of the 
applicant was "obviously acceptable." The dental hygiene staff gave 
this rating to 50 percent of the applicants. The non-dental hygiene 
staff interviewers gave 46 percent of the applicants the same rating. 
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. Percentile ratings given by a inajbrity of interviewers were high. 
The dental hygiene staff ratted*' 88 percent of the applicants at the 
75^th percenjiile or higher. Eighty-Qlie percent of the applicaiilts 
received similar ratings from t;he non-4fental hygiene interviewers. 

Interrater Agyetment . • 

'The means for the total item score, single item score, percentile ratipg 
and acceptability rating given the applicants by the dental hygiene and non- 
dental hygiene staff interviewers are presented in Table 17. The mean acceptability,, 
, rating given by the dental hygiene staff was similar to the mean acceptability 

j^atlng given by the non-dentaS^ hygiene staff. However, the mean ratings were 

> 

somewhat dissimilar for the other tv/o rating variables (total item score ad j listed 
for difference in number of items and percentile rating) . Interrater agreement 
on the acceptability rating was evidenced by a non-significant t^ (p>.10) 
used for the comparison of the means for the group of 'all applicants. Lack of 
Interrater agreement on the percentile rating was evidenced by a significant t^ 
(p<.05). There was also a tendency for a lack of agreement on the total score 
rating (adjusted for the difference in number of items) as evidenced by a signi- 
ficant It at the 0.10 level of significance. In both cases, non-dental hygiene 
Interviewers tended to give higher ratings than did the dental hygiene staff 
interviewers. It should be noted that although not significant, the mean group 
acceptability rating was also higher from the non-dental hygiene interviewers 
than from the dental hygiene staff. 
Applicant Subgyoup Mean Comparisons % 

. For the purpose of ranking applicants, the selection committee summed the 
total score given each applicant by the dental hygiene staff and non-dental 
hygiene staff interviewers. The maximum total was 105 points. Although ten 
points was added for all Johnson County residents, this bpnus was not included ' 
in the data analyses. The average summed score for all applicants was 86.29. 
The averages for the accepted and combined alternate-rejected groupo were 
92.50 and 77.43, respectively. p - 
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On the average, the dental hygiene ataff^tftlngs significantly (p<.01) ' 
differentiated^^e accepted applicants from the alternate-rejected applicants 
on all three variable* (total, score adjusted for difference in number of 
items, percentile rating, acceptability rating). This w<is also the case for 
the non-dental hygiene staff for all three ritings. 

Inf ry«f r Rellabl li tv ' 

The matrix of correlation coefficients for the all applicant group Is 
• pr«Bent«d in Table 18. The analysis revealed a significant (p<.05) positive 
relationship between the rating* by deTital hygiene staff interviewers and the 
non-dantal hygiene staff Interviewers on two variables (total Item scores and 
parcentlle rating). Therefore, If applicant A received a higher total Item 
score (or percentile rating) from a dental hygiene staff Interviewer than ap- 
plicant B, then applicant A tended to receive a higher total Item score (or 
percentile rating) from a non-dental hygiene staff Interviewer than applicant B. 
Figures 4 aild 5 graphically present the relationships for total Item scores and 
percentile ratings » respectively. 

> » * 
For the acceptability rating, there was a non-slgnlf leant relationship 

between ratings assigned by dental hygiene staff and non-dental hygiene staff 
intervlewere. The relationship Is presented graphically In Figure 6.* 
Applicant Subgroup Correlations 

The c9rrelatlon coefficient matrices for the accept'ed and the rejected- 
alternate sub-groups are presented In Tables 19 and 20, respectively. Within 
both the accept e'd and rejected-alternate sub-groups the analysis revealed non- 
significant relationships between the ratings by dental hygiene staff inter- 
viewers and non-dental hygiene staff interviewers on all three variables (to- 
tal item score, percentile rating, acceptability rating). The plots of these 
non-significant relationships suggest some lack of agreement between dental 
hygiene staff and non-dental hygiene staff interviewers regarding the relative 
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standing of applicants within a given sub-group* 

.V 

Total Spore Dl8trlj)Utl0tt for Individual Interviewers 

Overall, total Item scotres received by different. applicants Interviewed 
by «the same Individual were somewhat distributed across ^e range of possible 
total Item scores^. This suggests * that th^ Instrument did provide some degree 
of discrimination between applicants • However, there was tendency for a 
few Interviewers to assign a high percentage of applicants they Interviewed 

r * 

the same or very similar total Item scores. For e^gample, one non-dental > 
hj^glene staff Interviewer assigned five of the seven applicants Interviewed 
a score at or between 47 and 49* . 

Relationship of Total Score to Acceptability Rating 

The relationship of the total Item score received by the applicant to 
the opinion of the Interviewer regarding the acceptability of the ^ame 
applicant Is presented In Table 21 for the dental hygiene staff Interviewers 
and Table 22 for the non-dental hygiene staff Interviewers. 

Overall » applicants with high total 0core ratings recelved^hlgh accept-, 
ability ratings. For the all applicant group (Table 18), the correlation 
coefficients for total *ltem scores with acceptability ratings were .71 and 
.66 for the dental hygiene and non-dental hygiene Interviewers, respectively. 
These correlations were significant at the .01 level. 

Tables 21 and 22 reveal that there was some degree of overlap and Incon- 
sistency between total ^core and acceptability rating. For Example, one 
applicant receiving a tot^j^ Item score In the 29 to 31 range from a non- 
dental hygiene staff Interviewer was rated by the Interviewer as "outstanding" 
(rating //5) . However, an applicant receiving a total Item score In the 32 to 
34 range from another non-dental hygiene Interviewer was rated by* the Inter- 
viewer as "possibly acceptable" (rating //2) . 



The majority of overlap occurred tietween^he "probably" and "obviously 

acceptable", categories (rating #3 and M) . For example, of the sixteen 

applicants receiving a total item score In the 38 to^46 range from dental ^ 

hygiene staff Interviewers, eight were rated as "prol}a.bly acceptable" and 

* * 

eight were rated as "obviously acceptable". 
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VII. DrSCUSSION 

The overfall results of- this evaluation indicated that the development 
an^ u^e of the structured Intexrview instruments this paiat year wa6 successful 
In several important respects. The findings of^the interviewer oplnionnaiise 
revealed that the majority of the interviewers had a favorable overall 
reaction to the structured interview Instruments and related Interview 
procedures. The majority of the respondents did not feel that major revisions 
should be made in the instruments, the scoring procedures or the time allotted 
for the Interview. A high percentage of the interviewers indicated that the 
use of optional questions provided them a desired latitude-v^ This flexibility 
enabled them to approach a given characteristic in a manner which suited 
them personally. While some of the interviewers were critical of the subjec- 
"tlvity inv|olved in the rating system, the majority of the IntervlewerG did not 
comment that they were particularly uncomfprtable making subjective judgments 
regarding an Applicant *s qualifications. 

In addition to perceptions by the interviewers, the evaluation was 
concerned with examining the validity and reliability of the Interview 
instruments. The validity of the interview instrument can best be examined 
after the students selected during tKe spring of 1975 have graduated from 
JCCC. However, an instrument which is not reliable cannot be valid. There- 
fore, an examination of the reliability does provide some evidence for the 
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inference of validity. Some write^rs includlr^g Tinsley and Weisa (1975), 
have enqphaslxed the distinction between "Interrater agreement" and 
"interrater reliability" oxKd the need' for both types of evidence when ^ ' ' 
examining ratings. The interrater agreement and Infterrater reliability , 
information vn^s presented in Section V for the nursing applJLcant ratings, 
and in Section VI for the dental hygiene applicant ratings. The dls- 
cuBslon which follows is an Integratloii of the results for both the 
nursing and dental hygiene applicant ratings. 

InDBrrater Agreement Between Program Staff a^idy)t her Interviewers 

The characteristics measured by the "program staff" and "other staff" 
^fjatervlewers V£)re not selected to be exclusive from each other. Rather, the! 
two groups of interviewers were to rate equally important aspects of an 
effective nura^ of: dental hyglenlst. The question of Interrater agreement 
• is whether a rating assigned an applicant by a single Interviewer is indepen- 
dent of whether the interviewer is a member of that particular program staff. 
If so, the ratings given by the program staff should be similar to the 
ratings given by the non-program staff interviewers. 

Overall, the nursing staff interviewers gflve ratings to the nursing 
program applicants which were very similar to the ratings given by the non- 
hursing staff interviewers on all three variables (tot£^^ score adjusted for 
difference in t]i^mber of items, percentile rating, acceptability rating). 
The ratings by dental hygiene staff interviewers and non-dental hygiene staff 
interviewers were similar with respect to acceptability ratlngG(. However, 
there was some lack of agreement between their ratings on the other two 
variables (total score adjusted for difference in number of items, percentile 
rating). For each of the latter ?^/o variables, the ratings from the^ non-dental 
hygiene staff tended to be higher than the. ratings from the dental hygiene staff. 



since t^ie final selection of applicants Is based upon the total Item 
scores, the interrater agreement Is particularly important for this variable. 
If the ratings are very dissimilar ^ a low' rating by one interviewer cjSuld 
result In the applicant's rejection even if the ather interviewer's rating 
were maximum. The reason this could occur is that the twQ scores are summed 
and the Ipwfer rating would contribute little to the total score. For example, 
a rating, Qf 55 (maximum) from a dental jhy^iene staff member coupled with a / 
ratj.ng of 10 (minimum) from a non-dental hygienife staff member would result 
in a total score of 65. Such ap applicant would be rejected.^ Although the 
difference between the mean total^ score ratfiigs was significantly different 
only for the two groups of dental hygiene program interviewers, some discre- 
pancies for individual applicants did occui? between the tvo groups of nursing 
program interviewers. * , 

. Low interrater agreement may occur when interviewers who axe not members " 
of the program staff are not thoroughly familiar with the program for which 
they are interviawing applicaat;s. An understanding of the characteristics 
ais related to the particular program may assist an interviewer in dif feren- 
tiating one level such as "averag^" from, another level such as "above average." 
Compared tb nursing, denta^ hygiene is a career which is undoubtedly less, 
f^iliar to most persons. As a result, some of the demands ojua-jiental hygienist 
may require attributes of which the non-dental hygiene ataff interviewers may 
not be aware. This may partially account for the fact that there is lower 
interrater agreeme^it for dental hygiene than for nursing. 

The cross-tabulations between acceptability ratings and total; item score 
ranges for both nursing and dental hygiene interviewers also indicate some 
lack of understanding concerning the meaning^of ratin^^ The^e data are 
presented ^n^j^ables 11 and 12 for nursing interviewers\nd\n \^ables 21 and 22 



for dental hygiene interviewers. The cross-tabulations reveal som6 differences 
between interviewers in their perception of yha^^t total item scores differentiate 
an acceptable applicant from an outstanding applicant, v Thes^ differences 
probably reflect some disagreement in the assignment of ratings on single items 
as well. The written comments from the interviewers (see page 7 o£ this report) 
indicates a need for the "program staff" and "other stafl'! interviewers to 
discuss the characteristics to be assessed in terms of their application to 
nursing and dental hygiene. This comment is pertinent and such a discussion 
may be essential for dental hygiene interviewers before the interviewing 
process is conducted again. Since there was some disagreement by interviewers 
of nursing applicants^ an interchange between nursing staff and non-nursing 
staff interviewers would also be helpful. Staff Development Week might be , 

Oiie podsible time for such an interchange. v 

* 

Bonus for Johnson County Resident s 

Seventy-one (87%) of the 82 applicants to the nursing program and 19 (56%) 
of. the 34 applicants to the dental hygiene progrto were from Johnson County. 
The^data analyses for this report excluded the ten point bonus given to resi- 
dents of Johnson County. The reason for the exclusion was to remove a variable 
not directly related tlo the .perceptions of applicants by th^ interviewers . 
However, the jLn'terpretation of the results must include a consideration of 
the effect that the ten point bonus did have^upon the final applicant selection. 
-It is worth noting that 90 percent of those finally accepted into the nursing , 
program and 54 percent of those finally accepted into the dental hygiene pro- 
gram" were from Johnson County. If the total scores without the bonus for the 
Johnson County residents were comparable to» the total scores for the non-res i- ' 
dents, the percentage of residents in the final accepted group would be expected 
to be larger than the percentage of residents in the entire interviewed group. 
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For each program, the two percentages were comparable (90% an^y 87% for 
nursing, 54% and 56% for dental hygiene). Therefore, as a group, the total 
scores for Johnson County residents tended to be lower than for non-residents « 
The use of the h.onus did help some residents galti preference over non-resi- 
dents who obtained higher or similar Interview ratings, thus, the bonus Is 
a factor that explains^ some of the total score overlap between accepted and 

^alternate applicant^ or between alternate and rejected applicants. ^ 

^ Interrater Reliability 

The question of Interrater rellalplllty Is whether the ratings by 
S 

either a program staff or a noh^program staff Interviewer could be relied 
on as a means of ranking the applicants relative to one another. The 
ratings^ given by the program staff need not be the same as the ratings 
given by the non-program staff, but either set of ratings should result 
In a similar ranking of applicants. • - 

Fifty-four percent of the Interviewers (see page 7 of this report) 
felt the questions on the Interview Instrument were useful In discriminating- 
between applicants In terms of their potential for nursing or dental 
hygiene. Twenty-three percent expressed some doubts. The Interviewer 
comments are consistent with- the analysis of the applicant ratings. For 

oth nursing ^d dental hygiene, there was a significant positive relation- 
ship between the program staff and non-program staff on two variables 
(total item score and percentile rating)* For nursing, there was also ^a 
significant positive relationship on the acceptability. rating. However, 
the correlations ranged from 0.38 to 0.40 for the nursing applicants and 
from 0.16 (acceptability rating) to 0.60 (percentile rating) for the dental 
hygiene applicants. None of these correlations is very large. Thus, there 
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was some dls'agreement between program staff and non-program staff regarding 
the relative ranking of applicants. The disagreement was more evident when 
the correlations were examined for the subgroups (accepted, alternates, re- 
jected). The subgroup correlations for the program staff and non-program 
8 taf f> ^ratings tended to be non-slgnlf leant or negative. In part, these 
negative or non-si gnlf leant relationships are an artifact of the way the 
suibgroups were formed. As the plots in Figures 1-6 reveal, however, there 
are a few instances where program st^ff and other staff lnterv;lewers show 
a strong disagreement. This suggests that unless these cases of disagreement 
can be resolved. It Is Inappropriate to base selection of applicants on a 
ranking based solely on the sura of the total scores received from the two 
Interviewers. The effect of the suiraning of two total scores which are some- 
what In disagreement coupled with the effect of the bonus for Johnson County 
residents can be l^ustrated by considering two nursing applicants. One 
applicant (A) received scores of 31 and 51 while a second applicant (B) 
received scores of ^31 and 55. Applicant A was rejected while applicant B, 
who as a resident received a bonus of ten points, was accepted. The ratings 
(31 and 31) by the non-nursing staff were very lo«^ compared to the nursing 
staff ratings (51 and 55). ^ fj^ie opinion of a third Interviewer who was know- 
ledgeable about nursing may have helped determine Why the two Interviewers 
gave such divergent ratings. 

Implications and Changes In Selection Procedures 

With some disagreement concerning the relative ranking of applicants 
and some applicants receiving dissimilar ratings from two different inter- 
viewers, some changes may need to be made in the procedure for the final 
selection. For applicants who receive two diverse ratings, the applicant 
might be asked to return for a third interview^ If the third interview 
concurred with one of the other two, the remaining rating might be discarded. 
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It Is possible, however, -that the third Interview may not concur with either 
of the originals .% The problem may then be . to decide whether, the third inter-' 
view does concur or not. 

During the final selection of the class of 19*77, the selection committee 
found that there were a number of ties when the summed total scores were ^ 

• • - . ■ . - 

us^d to rank applicants. The appeals committee also found that it was 

'■ ■ .4 

diffitrult to make a decision for some of the appeals. The selection 
committee was given the authority to "break the tie" using other specified 
criteria. The ACT test scores were one acceptable criterion, but these • 
were not available for all applicants. Some members of the appeals committee 
have Indicated that one more piece of information available for all applicants 
would have helped them in reaching their final decision. 

After the interview and appeals process was completed for the class 
of 1977, the Program Selection Criteria Committee recommended that all 
applicants to the nursing and dental hygiene progr^mis be required to take 
the ACT test. The Board of Trustees approved the change la selection 
procedure during August 1975. As ACT data will provifde one piece of 
uniform data for^all applicants, this information could provide a means 
for making k decisiafi ^or an applicant who receives two diverse interview 
ratings. Since the use of a third interview may not reconcile the differ- 
ence and interviewing is a costly item, a procedure could be developed 
to incorporate the ACT test scores into the final applicant ranking. The 
ACT scores could also be used to "break ties" for applicants with identical 
interview ratings. However, the ACT tests measure academic ability and the 
interview process was concerned with personal characteristics other than 
acade||iic ability. 
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VIII . SUMMARY AND RECOMMENDATIONS 

I.' 

A s'tructured Interview was used during th§ spring of 19J5 as a tool 
^ for the final selection of nursing and dental hygiene students. The final 
selection was made by ranking applicants according to a total summed score 

"V 

obtained by adding the total score rating by a p;|^ogram staff Interviewer 
to the total score rating by a non-program staff Interviewer. A bonus of 
ten points vas given to all Johnson County residents. Although not used 
fpr selection purposes, Interviewers also gave each applicant a percentile 

rating and an acceptability rating (from unacceptable through outstanding) 

The results of the evaluation of the structured interview instruments are 

summarized below. 

. The majority of interviewers had a favorable overall reaction 
\ to the structured interview Instrument and related procedures. 

Nursing staff and non-nursing staff tended to give comparable 
ratings to the same applicant. While nursing staff and non- 
nursing staff did give divergent ratings to some applicants, 
there were fewer dissimilarities for nursing than for dental 
*' / " hygiene. The ratings given by the dental hygiene staff tended 
to be lower than the ratings given by the non-dental hygiene 
staff. 

. Although the correlation coefficients used to assess the simi- 
larity of the ratings by the program staff and the non-program 
staff interviewer were statistically significant, they v^ere low 
.with the maximum being 0.60. Thus, there was some disagreement 
between program staff and non-program staff regarding the relative 
ranking of applicants. 

A summary of the majot implications of these results and previous 

research findings is presented below together with the accompanying 

recommendat ions . 

Continuation of Structured Interview 

The structured interview Instrument and related procedures may not 
be appropriate to use as the only means for selecting applicants into the 
nursing and dental hygiene programs. However, the evidence^ indicates that 
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the structured Interview does offer a means to identify students who should 

be rejected. The major problem is one of( distinguishing those who should 

be accepted from those who should be alternates* 

Recomnendatlon 1: That the structured interview continue to be used 

as a tool for selecting' nursing and dental hygiene 
students* 

Interviewer Understanding of Health Related Programs 

There is a need for discussion between the program staff and non-progrsm 

t) 

staff prior to the interviewing process. The interchange is almost essential 

before the dental hygiene intetviewing begins. The field of nursing is 

familiar to more persons than is the field of dental hygiene, but some 

discussion would undoubtedly also benefit interviewers of nursing applicants. 

Recomwendation 2: That for both the nursing and dental hygiene 

programs the program staff and non-program 
staff meet prior to the interviewln'g of appli- 
cants and discuss the personal characteristics 
which are indicative of an applicant's potential 
. for that particular health program. The dis- 
cussion should include consideration of the 
various levels of a given characteristic ranging 
from "well below average" to "well above average." 

Decisions for Applicants with Tied Rank or Dissimilar Ratings 

Some procedure needs to^be developed so that decisions can be made for 

applicants with two dissimilar interview ratings. A procedure is also needed 

for making a decision of "accept" or "alternate" for some applicants who. 

^* receive tied ranks. If two. applicants with the same rank can be accepted, 

there is no problem. But if only one can be accepted and one must be an 

alternate, someone must make that decision. 

A third interview with a member of the appropriate career program staff 

is one possibility which would permit another assessment of an applicant's 

strengths and weaknesses. One of the original two interviewers may have 

detected primarily the strengths while the second interviewer may have 
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detected primarily the weaknesses. An Interview with another member of the 
program staff would permit an assessment as to whether the strengths can com- 
pensate for any perceived weaknesses. To accomplish this assessment, the third 
interview would neJed to be a less structured interview. Also, to accomptlish 
thi^ within a reasonable amount of time would require that this program staff 
interviewer have access to the applicant's complete file prior to the interview. 

A similar procedure could be used for students who receive tied ranks. In 
view o^the data on interrater agreement, it Is unlikely that for a spetific 
applicant the rating received from a prpgram staff interviewer will be identical 
to the rating received from a non-program staff interviewer. Therefore, if 
two. or more applicants do receive the same rank and only one can be accepted, 
an interview by anotKfer member of the program staff is one way to make an 
informed decision. Again, the interview should be less structured and the 
applicant's complete file should be available prior to the Interview. 

RQcommondatlon 3: That a second member of the appropriate career pro- 
gram interview all applicants who receive two dis- 
similar ratings in the original interviewing process^ 
^ and all applicants with tied ranks for whom a decision 

of "aceept" or "alternate" must be made. Prior to 
these interviews, the interviewer will have access 
to the applicant'^ complete file. 

The t^rm "dissimilar ratings" id.ll need to be defined more fully. For 

f 

the first year, the Pi;ogram Criteria Selection Gommittee ehbtild make some 

decision |/ith the understanding that in future years the definition may 

change as the staff becomes more familiar with the Interviewing process. 

Initially, the definition would be expected to include more applicants than 

would be expected in a couple of years. 

Recoimendatlon 4: That the Program Criteria Selection Committee develop 

a definition of "dissimilar ratings" to be used for 
the class of 1978 with the understanding that the 
definition for future classes may change. Prio^j to 
implementation, the definition should be presented 
to the administration and other relevatit college 
staff for their input. 
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TABLE 1 



INTERVIEWER OPINIONS OF THE NURSING AND DENTAL HYGIENE 
STRUCTURED INTERVIEW INSTRUMENT 



Item 



Number 
Responding Percentage 



Was 20 minutes sufficient time to satisfactorily 
complete the interview? 
Yes 

No ' • . 

Were the explanations for each of the character- 
istics to be assessed sufficient? 
. Yes 

Some explanations Insufficient 
No 



17 
5 



16 
3 
3 



77% 
23% 



72% 
14% 
14% 



Did the questions provided in the instrument permit 
you to differentiate between applicants in terms of 
their potential for nursing or dental hygiene? 
Yes 

Ambivalent 
No 

No response 

Should the range of possible ratings be expanded 
from five (well belov/ average, below average, 
average, above average, well above average) to 
some larger number? 

Yes 

No 

Don't know 

Would the interview instrument be improved by 
limiting the number- of optional questions on 
each characteristic? 

Yes 

No 

No response or don't know 

Would the interview in8trumen£ be Improved by 
requiring that each interviewer ask the same 
quesj^lon on each characteristic? 

No 

Don't know 

What was your overall impression of the structured 
Interview instrument? 

' Favorable 

^ Unfavorable 
Other 



12 
5 
1 
4 



2 

19 
1 



0 
19 
3 



1" 
19 
2 



17 
3 
2 



54% 
23% 
5% 
18% 



9% 

86% 

5% 



0% 
86% 
14% 



5% 
86% 
9% 



77% 
14% 
9% 



ERIC 



2^ 



TABLE 2 



FEIEQUENCY AND PERCENTAGE OF TOTAL ITEM SCORES 




ASSIGNED BY NliRSING STAFF INTERVIEWERS, 




Total Item Score Range (a) 


Frequency 


. Percentage 


29-31 (b) 


3 


3.7% 


32-34 






35-37 


5 


ti 


38-40 


11 


13.4 


41-43 


10 . 


12.2. 


44-46 


13 


15.9 


47-49 


12 


14.6 


. ^ 50-52 , 


16 


19.5. 


53-55. 


10 


12.2 


• • Total 


82 


100. QZ 



(a) There were 11 items on the form used by the nursing Interviewers. For 
each item, the responses ranged from 1 (denoting well below average) to. 5 

. (denoting well above average). Thus^ total item scores could range from 
11 to 55 on the nursing interview form. 

(b) No applicant received a total item score lower than 29 « 



TABLE 3 

FREQUENCY AND PERCENTAGE OF ACCEPTABILITY RATINGS 
ASSIGNED BY NURSING STAFF ^INTERVIEWERS 



Acceptability Rating Frequency Percentage 

1 (unacceptable) 1 1.2% 

2 (possil^ly acceptable) 8 9.9 

3 (probably acceptable) 20 24.7 

4 (obviously acceptable) 37 45.7 

5 (outstanding) 15 18.5 

-z Total 81 (a) 100. OZ 



(a) One of the nursing interviewers did not assign an acceptability rating to 
one interviewee. 

3 ; 

29 



TABLE 4 

FREQUENCY AND PERCENTAGE OF TOTAL ITEM SCORE|; 
ASSIGNED BY NON-NURSING STAFF INTERVIEWERS C 



■ 

Total Item Score Range (a) 


Frequency 


Percentage 


20-22 (b> 


1 


» 

1.2% 


23-28 


2 


2<4 


* 29-31 


6 


7.3 


32-34 


5 


6.1 


35-37 


10 


12.2 


38-40 


12 


14.6 


. 41-43 


14 


17.1 


44-46 


• 23 


28.1 


47-50 


9 


11.0 


Total 


82 


'-^^ ' 100.0% 



(a) There were 10 items on the form used by -the non-nursing interviewers. For 
each item, the responses ranged fro^ 1 (denoting well below average) to 5 
(denoting well above average). Thus, total item scores could range from 
10 to 50 on the non-nursing interview form. 

(b) No applicant received a total item score lower than 20. 



TABLE 5 

FREQUENCY AND PERCENTAGE OF ACCEPTABILITY RATINGS 
ASSIGN^) Bt NON-NURSING STAFF INTERVIEWERS 



Acceptability Rating' 



Frequency 



Percentage 



1 (unacceptable) 

2 (pbssibly acceptable) 

3 (probably acceptable) 

4 (obviously acceptable^ 

5 (outstanding) 




Total 



2 

6 
17 
43 

13 

81 (a) 



2.5% 
7.4 
21.0 
53.1 
16.0 
100.0% 



(a) One pf the non-nursing interviewers did not assign an acceptability rating 
to one interviewee. 

36 
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TABLE 6 



MEANS FOR FOUR VARPbIeS ON INTERVIEW INSTRUfiENT 
FOR PROSPECTI\K NURSING STUDENTS 



Applicant "Group 



Total Item Average Item Percentile 
Score (a) Score (b) Tlatlng (c) 



Acceptability 
Rating (d) 



Accepted 
Nursing 

Interviewers^ 49.63 
Non-nursing 

interviewers ^ 43.80 
Total 93.43 



4.51 
4.38 



88.95 
89.47 



4.20 
4.18 



Alternates 
Nursing 

Interviewers 45.13 
Noti-nurslng 

interviewers 40.93 

Total • 86.06 



4.10 
4.09 



85.47 
82.17 



3.79 
3.79 



Rejected 
Nursing 

interviewers 
Non-nursing 
interviewers 
Total 



38.96 

34.70 
73.66 



3.54 
3.47 



69.30 
72.16 



2.93 
3.04 



All Applicants 
J Nursing 

interviewers 45.29 
Non-nursing 

interviewers 40. 28 

Total 85.57 



4.12 
4.03 



81.84 
82.14 



3.70 
3.73 



(a) There were 11 Items on the form used by nursing interviewers and 10 items 
on tne form used by non-nursing interviewers. For each item,' the responses 
ranged from 1 (denoting well below average) to 5 (denoting well above aver- 
age). Toktal item scores could range from 11 to 35 on the nursing interview 
form and from 10 to 50 on the non-nursing interview form. 

(b) Since the number of items on the two forms was unequal, the average total 
item points was divided by li*ie number of items to permit some compar^on. 

(c) Each interviewer was request«d to evaluate the applicant overall using a 
percentile ranking. ^ 

(d) Each interviewer was requested to rate the applicant overall from 1 
(unacceptable) to 5 (outstanding) . 



ERIC 
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TABLE 7 



INTERCORRELATION MATRIX OF SIX INTERVIEW . 
VARIABLES FOR ALL APPLICANTS 
NURSING PROGRAM 

> 

Variable , ^ Variable Number 

Number 1 2 _^ 3 4 5 _6 



1 


1.00 . 














( 82) 












>2 ^ 


.71 


1.00 












( 82) 


( 82) 










3 


.79 


-.70 


1.00 










( 81)_ 


( ^1) 


( 81) 








4 




.42 


.36 


1,00 








( 82)^ 


82) 


( 81) 


( 82) 






5 


.31 


^--.40 


.31 


.89 


1.00 






( 71) 


( 71) 


( 70)' 


( 71) 


( 71) 




6 


.37 


.41 


.39 


.82 


.84 


1.00 


• 


( 81) 


( 81) 


( 80) 


( 81) 


( 71) 


( 81) 



TABLE 8 

INTERCORRELATION MATRIX OF SIX INTERVIEW 
VARIABLES FOR ACCEPTED APPLICANTS 
NURSING PROGRAM 



Variable Variable Number 



Number 


1 


2 


3 


4 


5 . 


6 


1 


1.00 














( 40) 












2 


.22 


1.00 












( 40) 


( 40) 










3 


.56 


.34 


1.00 










( 40) 


( 40) 


( 40) 








4 


-.39 


-.08 


-.24 


1.00 








( 40) 


( 40) 


( 40) 


( 403r 






5 


-.32 


-.14 


-.24 


.88 


1.00 






( 34) 


( 34) 


( 34) 


( 34) 


( 34) 




6- 


-.30 


-.06 


-.16 


.67 


.76 


1.00 




( 40) 


( 40) 


( 40) 


( 40) 


( 34) 


( 40) 



Variable Number Variable Name 

1 Total item scores by nursing staff Interviewers 

2 Percentile rating by nursing staff Ijitervlewers 

3 Acceptability ratings by nursing staff Intervlewjers 

4 Total Item scores by non-nursing staf ^Interviewers 

5 Percentile ratings by non-nursing staff interviewers 

• 6 Acceptability rating by non-nursing staff interviewero 

0 



,9^" Note J The numbero in parantheses denote the number of students for whom the 

Jv> interviewero had provided data on both variables. 



r 

I 



TABLE 9 




■ ' INTERCORREIATION MATRIX OF SIX INTERVIEW 
VABlIABLES FOR ALTERNATE APPLICANTS 
NURSING PROGRAM 



Variable Variable Number 



Number 


1 


2 


J 


/i 


C 
J 


0 


1 • 


1.00 














( 15) ' 












2 


.44 


1.00 












( 15) 


( 15) 




s 






3 


.70 ' 


. .61 


1.00 










( 14) 


( 14) 


( 14) 








K 


-.68 


-.19 


, -.30 


1.00 






( 15) 


( 15) 


( 14) 


( 15) 






5 


-.86 


^.17 


-.42 


.90 


1.00 


u_ 




( 12) 


( 12) 


( 11) 


( 12) 


( 12) 




6 


-.60 


.01 


-.25 


.79 


. .84 


1.00 




< 14) , 


( 14)' 


( 13) 


( 14) 


( 12) 


( 14) 



TABLE 10 



INTERCORIIELATION MATRIX OF SIX INTERVIEW 
** VARIABLES* FOR REJECTED APPLICANTS 
. NURSING PROGKAM 



Variable Number Variable Name 



Variable 
Number 






Variable 


Number 






1 


2 


3 


4 


5 


6 


1 


• 1.00 














( 27) 












"2 


.70 


^ 1.00 












( 27) 


( 27) 










3 


.68 


.64 


1.00 










( 27) 


( 27) 


( 27) 








4 


, -.01 ^ 


.10 


.05 


1.00 








( 27) 


( 27) 


( 27) 


( 27) 






5 


.10 


.18 


.17 - 


.80 


■ 1.00 






( 25) 


(- 25) 


( 25) 


( 25) 


( 25) 




6 


.20 


.20 


.34 


.75 


.78 


1.00 




( 27) 


( 27) 


( 27) 


( 27) 


( 25). 


( 27) 



1 

3 
4 
5 
6 



Total item scores by nursing staff interviewers 
Percentile ratings by nursing staff Interviewers 
Acceptability ratings by nursing staff interviewers 
Total item scores by non-nursing staff interviewers 
Percentile ratings by non-nursing staff interviewers 
Acceptability ratings by non-nursing staff interviewers 




Note: The numbers in parentheses denate the number of students for whom the 
interviewers had provided data on both variables. A I 

. ■ 33 - 



W TABLE 11 

FREQUENCY OF ACCEPTABILITY RATINGS BY^TOTAL' ITEM SCORE RANGES 
FOR NURSING STAFF INTERVIEWERS 



Acceptability Rating (a) 



tern Score Range (c) 


1 


2 


' 3 


4 


5 


Total 


29-31 


1 


1 


- 


. 1 


- 


3 


32-34 




2 








2 


35-37 




3 


2 






5 


38-40 




1 


8 


1 




10 


41-43 




1 


6 


3 




. IP 


44-46 






2 


9 


2 


13 


47-49 






1 


10 


1 


12 


50-52 






1 


12 


3 


, 16 


53-55 








1 


9 


10 


Total 


1 


8 


20 


37 


, 15 


81 (b) 



(a) For purposes of computation the acceptability ratings - unacceptable,- 
jposslbly acceptable, probably acceptable, obviously acceptable, and out- 
standing - were assigned values of 1 through 5» respectively. 

(b) One applicant was hot assigned an acceptability rating by a nursing staff 
interviewer. 

(c) No applicant received a total item score of less than 29 from a nursing 
staff interviewer. Total item scores could range from 11 to 55 on the 
nursing staff interview form. 

TABLE li 

FREQUENCY OF ACCEPTABILITY RATINGS BY TOTAL ITEM SCORE RANGES 
FOR NON-NURSING STAFF INTERVIEWERS 



Acceptability Rating (a) 



Total Item Score Range (c) 


1 


2 


3 


4 


5 


Total 


20-22 




1 










1 


23-25 














0 


26-28 






2 








2 


29-31 




1 


2 


2 


1, 




^ 6 


32-34 






2 


1 


2 






35-37 








8 


2 




10 


38-40 








4 


7 




11 


41-43 








2 


12 




14 


44-46 










17 


6 


• 23 


47-49 




, >_ 






2 


7 


° .9 




Total 


2 

J. ts ^ 


6 


17 


43 


13 


81 (b) 



^(a) For purposes of computation the acceptability ratings - unacceptable, 

possibly accep table, < probably acceptable, obviously acceptable, and out- 
standing - were assigned values of 1 through 5, respectively. 

(b) One applicant was not assigned an acceptability rating by a non-nursing 
staff interviewer. 

(c) No applicant received a tptal item score lower than 20 from 'a, non-nursing 
staff interviewer. Total item scored could range from. 10 to 50 on th 
non-nursing .staff interview form. 



TABLE 13 



FREQUENCY AND PERCENTAGE OF TOTAL ITEM SCORES 
ASSIGNED BY DENTAL HYGIENE STAFF INTERVIEWERS 



Total Item Score Range (a) 



Frequency 



Percentage 



32-34 
35-37 
38-40 
41-43 
44-46 
47-49 
50-52 
53-55 



(b) 



Total 



I 

3" 

6 

4 

6 
11 

2 

1 
34 



2.9% 
8.8 
17.7 
11.7 
17.7 
32.4 
5.9 
2.9 
100.0% 



(a) There were 11 items on the form used by the dental hygiene staff inter- 
viewers. For each item, the responses ranged from 1 (denoting well below 
average) to 5 (denoting well above average). Thus, total it^m scores 
could range from 11 to 55 on the dental hygiene staff interview form. 

(b) No applicant received a total item score lower than 32. 




TABLE 14 . 

FREQUENCY AND PERCENTAGE OF ACCEPTABILITY RATINGS 
ASSIGNED BY DENTAL HYGIENE STAFF INTERVIEWERS 



Acceptability Rating Frequency PercentaRe 

3 • 8.8 



1 (unacceptable) 

2 (possibly acceptable) 

3 (probably acceptable) 

4 (obviously acceptable) 



11 32.4 
' . 17 50.0 

5- (outstanding) _1_ -^^^ 
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TABLE 15 • - 

FREQUENCY AND PERCENTAGE OF TOTAL ITEM SCORES 
ASSIGNED BY NON-DENTAL HYGIENE STAFF INTERVIEWERS 

Total Ite m Score Range (a) ^_ Frequency Percentage 

26-28 (b) 1 ^ 2.9% 

29-31 , ^ 1 — 1.9 

32-34 4 ' ir.8 

35-37 2 5.9 

38-40 - 2 . 5.9 

41-43 5 14.7 

44-46 * 8 23.6 

47-49 10 ' - " * . 29.4 

50 1 2.9 



Total 34 100. QZ 



(a) There were 10 items on the form used by the non-dental hygiene staff 
interviewers. For each item, the responses ratnged from 1 (denoting well 
below average) to 5 (denoting well above average) . Thus, total item 
scores could range from 10 to 50 on the non-dental hygiene staff interview 
form. 

(b) No applicant received a total item score lower than 26. 



TABLE 16 



FREQUENCY AND PERCENTAGE OF ACCEPTABILITY RATINGS 
ASSIGNED BY NON-DENTAL HYGIENE STAFF INTERVIEWERS 



\ 

Acceptability Rating 


Frequency 


- Percentage 


a 

1 (unacceptable) 


0 ^ 


0.0% 


2 , (possibly acceptable) 


2 


7.2 


3 (probably acceptable) 


7 


25.0 


4 (obviously acceptable) 


13 


46.4 


5 (outstanding) 


6 


21.4 


Total 


28 (a). 


100, M 



(a) Six of the dental hygiene applicants did not receive acceptability ratings 
from a noh-dental hygiene staff interviewer. 
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TABLE 17 



MEANS FOR FOUR VARIABLES ON INTERVIEW INSTRUMENT 
FOR PROSPECTIVE DENTAL HYGIENE STUDENTS 



Applicant Group 



Total Item Average Item Percentile Acceptability 
Score (a) Score ^b) Rating (c) Rating (d) 



Accepted 

Dental hygiene 
Interviewers 
Non'-dental hygiene 
Interviewers 
Total 

Al ternates-Re j ec ted 
^ Dental hygiene 
Interviewers 
Non-»dgl»ia4_hyglene 
Int 
total 

All Candidates 
Dental hygiene 
Interviewers 
Non-dental hygiene 
Interviewers 
Total 




46,70 

45,80 
92.50 

40.14 

37.29 
77.43 

44.00 

42.29 
86.29 



4.25 
4.58 



86.58 
92,44 



3.85 
4.25 



3.65 
3.73 



4.00 
4.23 



76.71 
75.14 

82.39 
84.88 



3.21 



3.25 . 



3.59 
3.82 



(a) Tliere were 11 Items on the form used by dental hygiene staff Interviewers ^ 
and 10 Items on the form used by non-dental hygiene staff Interviewers. 
For each Itemt the responses ranged from 1 (denoting well below average) 
to 5 (denoting well above average). Total Item scores could range from 11 
to 55 on the dental hygiene staff Interview form and from 10 to 50 on the 
non-dental hygiene staff Interview form. 

(b) Since the number of Items on the two forms was unequal, the average total 
Item points was divided by the number of Items to permit some comparison. 

(c) Each Interviewer was requested^to evaluate the applicant overall using a 
percentile ranking, 

(d) Each Interviewer was requested to rate the applicant Werall from 1 
(unacceptable) to 5 (outstanding) » 



45 

37 



ims 18 



INTERCORREIATION MATRIX OP SIX INTERVIEW 
VARIABLES FOR ALL APPLICANTS 
DENTAL HYGIENE PROGRAM 



Variable 



Variable Number 



Number 


1 


2 


3 


4 


5 


6 


■ 

1 


1.00 










O 




( 34X 










2 


.73 


1.00 












( 33) 


( 33) 










3 


.71 

( 34) 


.74 - 
( 33) 


1.00 
( 34) 










.42 ' 


.55 


.42 


1.00 








( 34) 


( 33) 


( 34) 


( 34) 








.36 • 


.60 


.45 


.95 


1.00 




( 16) 


( 16) 


( 16) 


( 16) 


( 16) 


r.oo 


6 


.19 


.39 


.16 


.66 


.82 




( 28) 


( 27) 


( 28). 


( 28) 


( 16) 


( 28) 



TABLE 19 

INTERCORRELATIQN MATRIX OF SIX DJTERVIEW 
VARIABLES FOR ACCEPTED APPLICANTS 
DENTAL HYGIENE PROGRAM 



Variable 
Number 










Variable Niunber 








1 - 




2 


3 


4 


5 


6 


1 


1 


.00 














2 




20) 
.78 


1.00 












( 


19) 


( 


19) 










3 




.60 




.66 


1.00 










( 


20) 


( 


19) 


( 20) 








4 




.21 




.03 


-.02 


1.00 








( 


20) 


\ 


19) 


' ( 20) 


( 20) 






5 




.23 




.22 


-.20 


.68 


1.00 






( 


9) 


( 


9) 


( 9) 


( 9)v 


( 9) 








.24 




.13 


.12 


.37 


.29 


1.00 




( 


16) 


( 


15) 


( 16) 


( 16) 


( 9) 


( 16) 



Variable Number 
1 

' 2 

li 

5 
6 




Variable Name *' 
Total Item scores by nursing staff Interviewers 
Percentile ratings by nursing staff Interviewers 
Acceptability ratings by nursing staff Interviewers 
Total Item scores ^y non-nursing staff Interviewers 
Percentile ratings by non-nufslng staff Interviewers 
Acceptability ratings by non-nurplng staff Interviewers 



Note: The numberis In parantheseG denota the number of students for whom the 
Q Interviewers had provided data on both variables. 
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TABLE 20 



INTERCORRELATION MATRIX OF SIX INTERVIEW , 
VARIABLES FOR ALTERNATE-REJECTED APPLICANTS 
DENTAL HYGIENE PROGRAM 



Vantable 








Variable 


Number 






Nigbber 


1 




2 


3 


4 . 


5 


6 


1 


1.00 
















( 14) 














2 


.52 ' 


1 


.00 












( 14) 


( 


14) 










3 


.68 




.71 


1.00 










( 14) 


( 


14) 


( 14) 








4 


.08 




.46 


.33 


1.00 








( 14) 


( 


14) 


( 14)// 


( 14) 






5 


-.26 




.42 


-.15 


.80 


1.00 






( 7) 


( 


7) 


( 7) 


( 7) 


( 7) 




6 


-.19 




.22 


-.24 


.43 


.84 


1.00 




( 12) 


( 


12) 


( 12) 


( 12) 


( 7) 


( 12) 



Variable Number Variable Name 



1 
2 
3 
4 
5 
6 



Total Item scores by nursing staff Interviewers 
Percentile ratings by nursing staff Interviewers 
Acceptability ratings by nursing staff Interviewers 
Total Item -scores by non^nurslng staff Interviewers 
Percentile ratings by non-nursing staff Interviewers 
'Acceptability ratings by non-nursing staff Interviewers 



Note: The numbers In parantheses denote the number of st;udants for whom the 
Interviewers had provided data on both' variables . 




47 
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TABLE 21 



FREQUENCY OF ACCEPTABILITY RATINGS BY TOTAL ITEM SCORE RANGES 
* FOR DENTAL HYGIENE STAFF INTERVIEWERS 



Acceptability Rating (a) 
Total Item Score Range (b) 1 2 3 4 5 Total 



32-34 




1 








1 


35-37 




2 


1 






3 


38-40 






3 


3 




6 


41-43 






2 


2 




4 


44-46 






3 


3 




6 


47-49 






2 


8 


1 


11 


50-52 








1 


1 


2 


53-55 










1 


. 1 


Total 


0 


3 


11 


17 


3 


34 



(a) For purposes of computation the acceptability ratings - unacceptable, 
possibly acceptable, probably acceptable, obviously acceptable, and out- ^ 
standing - ^ere assigned values of 1- through 5> respectively. 

(b) No applicant received a total Item score lower than 32 from a dental 
hygiene staff Interviewer. Total Item scores could range from 11 to 55 
on the dental hygiene staff Interview form. 



TABLE 22 



FREQUENCY OF ACCEPTABILITY RATINGS BY TOTAL ITEM SCORE RANGES 
FOR NON-DENTAL HYGIENE STAFF INTERVIEWERS 









Acceptability Rating (a 


) 




Total 


Item Score 


Range (t) 


1 2 


3 


4 


5 


Total 




26-28 




1 








1 




29-31 










1 


1 




32-34 




- . 1 


3 






4 




35-37 






2 






2 




38-40 








2 




2 


41-43 






1 


4 




5 




44-46 






1 


5 


1 


7 




47-49 








2 


4 


6 




50 












0 






Total 


0 2 


7 


13 


6 


28 (b^ 


(a) 


For purposes of computation 


the acceptability 


ratings 


- unacceptal 


>l4W'^ 



possibly acceptable, probably acceptable, obviously acceptable, and out- 
standing - were assigned values of 1 through 5, respectively. 

(b) Six applicants did not receive an acceptability rating from a non-dental 
hygiene staff Interviewer. 

(c) No applicant received a total Item score lower than 26 from a non-dental 
hygiene staff Interviewer. Total Item scores coruld range from 10 to 50 
on the non-dental hygiene staff Interview form. V 
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. . ^ ♦ SUMMARY OF PREVIOUS SELECTION METHODS 

^ First Graduation Class 

The first nursing students graduated In 1973 while the first dental 
hygiene students graduated In 1974. In both cases, the selection was 
^baised on policies developed by the coordinator* The policies were approved 
by the Assistant Dean of Instruction and other appropriate Individuals 
within the college structure. 

Each selection coimnittee Included the appropriate coordinator and 
'another instructor in the program. All applicants to the nursing program 
were interviewed either by the nursing coordinator or the nursing instructor 
who was a member of the selection committee. All applicanti^^^ the dental 
hygiene program were Interviewed by the dental hygiene coordinator. 

The final selection of the dental hygiene students to be admitted was 
primarily based on the interview x^lth the coordinator and the coordinator's 
profession^ judgment' of the applicant. The nursing applicants were rank 
ordered from k~ to 60 by each member of the selection committee. Each 
individual's overall qiuallfl cations were considered in the ranking. With 
limited exceptions » the committee members gave similar rankings to the ma- 
T^orlty of tfie applicants. Candidates were selected on the basis of committee 
composite rankings . 

Nursing Class of 1973 - Enrolled August 1971 



Admitted - 50 
Withdrew - 9 

Death - 1 

Changed goals - 4 
, Academic problems - 2 * 

Personal problems - 1 ' 

Pregnancy - 1 

Transfer In - 4 4 
Graduates - 45 

Successfully pass State Board Examinations 
Ist attempt - 39 
2nd attempt - 6 
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Dental Hygiene Class of 1974 - Enrolled August X972 V 

Admitted - 24 ' 
Withdrew - ' 1 . 

Accident during last semester, could not perform clinically, 
1 * but did pass National Boards (academic) though she did not 

attemf>t Regional Boards (clinical) • 
Graduates -23 

Passed National Boards (graduates only) 
1st attempt - 22 ,v 

2nd attempt - 1 " . 

Passed Regional Boards - 23 
Completed program (Including summers) 

in 5 semesters - 2?; 

In 6 semesters - 1^ 
Licensed - 23 

Second Graduation Class 



No interview was required of applicants to either the nursing or dental 
hygiene program. The dental hygiene cpordinator did meet and personally 
counsel a limited number of appiicantS4 However, a majority of dental 
hygiene applicants were not counseled by anyone knowledgable about the 
profession and .its unique demands find rewards. The nursing applicants 
were not interviewed by any of the nursing staff members. 

For both programs, candidates who met the minimum academic criteria 
were admitted^ according to the order In which their applications were 
received. For the first time, an appeals procedure was available for 
nursing applicants. Space was reserved for successful appeals. 

Nursing Class of 1974 - Enrolled August 1972 

Admitted - 35 
Withdrew - 4 

Health - 2 

Dissatisfied with Nursing - 1 

Academic problems - 1 

Transfer In - 2 ^ 
Graduates - 33 

Successfully pass State Board Examinations 
1st attempt - 31 
2nd attempt - 2 
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Dental Hygiene Class of 1975 - Enrolled August 1973 
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Admitted - 24 
Withdrew - 9 

Death - 1 

. Lack of dexterity - 1 

'In,wtiong program - 3 

'Reason Unknown --4 
Grad^ates - 15 v 
Passed National Boards 

1st attempt - 14 

2nd attempt - 0 

3rd attempt - has not been taken yet 
Passed Regional Boards - 15 
Completejl program (including summers) 

in 5 semesters 13 

in 6 semesters - 2 
Licensed - 14 (another one yet could) 



Third Graduation C] ass 



The procedure 



for the selection of students into both programs was 
based on a random selection process. All applications received by^ a speci- 
fied date were revllewed to identify students who met the minimum academic 
criteria. The accepted students were selected at random from the respec- - 
tlve pool of academjlcally qualified studeats. Again, no interview was 
required. I 

r • 

Nursing Class (ff 1975 - Enrolled August IQWl 



^ 



Admitted - 
Withdrew - 



50 
13 



Academic problems 



- 10 



responsibilities - 



Family 

Health 

Changed goal 
Transfer In - 1 
l^admitted^ to program - 3 

From ciass of 1973 - 1 

From class of 1974 - 2 
Graduates - 41 



Dental Hygiene Class of 1976 - Enrolled August 1974 

Admitted - 27 
Withdrew - 8 

Academic problems - - 2 

In wrongs program - 3 

Financial - 1 

Health - - 1 
Program too demanding - 1 
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If comparisons are made with preceding years, the dental hygiene 
data for the class of 1976 must be Interpreted with care. These students 
are jtist beginning their second year In the program, so the withdrawals 
are for only the first year. 
Fourth Graduation Class 

The nursing students were again selected at random from the group 
that met the minimum academic criteria. Since the dental hygiene program 
started one year after the nursing program, the nuxober of graduation classes 
ls> always one less than for the nursing program. Thus, the fourth dental 
hygiene class was admitted for the Fall of 1975. The procedure for the 
selection of these students. Included the use of the structured Interview 
Vhlch is presented and discussed In this report. If comparisons are made 
with preceding years, the data below must be Interpreted with care. Th^ 
nursing data Included withdrawals for only the first year and the dental 
hygiene data are for only the first six weeks. 

Nursing Class of 1976 - Enrolled August 1974 

^Admitted - 50 ^ 
Withdrew - 12 
• Academic problems - 5 
Personal problems - 3 
Changed goal - 3 

Moved - 1 r 

Transfer In - 4 

Dental Hygiene Class of 1977 - Enrolled August 1975 

-Admitted - 26 

Withdrew - 0 (as of October 1, 1975) 
The dental hygiene program had room for only 24 students. The extra 
two students had been admitted since for both previous classes, at least 
two students had withdrawn within the first month. 
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Fifth Gradue^tlon Class , 

The structured interview presented in this report was used as a tool 
for the selection of the nursing students for this class. 

Nursing Class of 1977 - Enrolled August 1975 

Admitted - 50 ^• 
Withdrew - 0 (as of October 1, 1975) 
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APPENDIX B 



STRUCTURED INTERVIEW INSTRUMENT USED 
BY NURSING STAFF INTERVIEWERS 
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STRUCTDREIS INTERVIEW FOR SELECTION 



OF NURSING STUDENTS 



PROFESSIONAL INTERVIEW 



JCCC 



Today's Date 



Interviewer's Name 



Applicant's Name 



The following content areas are suggested for inclusion in a "Structured 
Interview" to be given applicants to the Department of Nursings Johnson 
County Community College » Overland Fark» r>Kansas. The items are not meant 
to be totally inclusive^ dince the interviews should have a degree of 
flexibility which allows the interviewer to follow the lead of the inter- 
viewee. This can> perhaps » best be done by asking "open'->ended" questions 
which draw out the applicants ideas » and by being supportive so as to put 
the applicant at ease. Questions which ask for behavioral evidence in 
addition to an applicant's ideas or feelings on a subject should also be 
included. The interviewer should feel free to pose his own questions if 
he chooses. « 



Please check the appropriate blank relative to how well you felt the 
applicant responded in each content area. We would also appreciate* 
your comments in the space provided 6n the last page as well as whether 
you feel the applicant should be accepted or rejected. Further » please 
indicate where you felt the applicant performed in terms of percentile 
ranking. For example^ 50% average^ 75Z above average^ 90% exceptional* 
etc. 




by Michael M. Burgess > Ph> 
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1. Perception of Nursing 

Questions Im this area should be directed at obtaining Information from the appli- 
cant relatlvt to their perception of nursing* Questions might cover areas Including: 
the understanding of nursing as a professloni the role of a nurse, the health care 
delivery systW^ th^ Influence behind their Interest In nursing* what they, feel 
the model for a nurse should b-e^ and vAiat Contact they may have had with nursing 

and/or health care. ^ 

(■ 



In obtaining responses to interview questions the Interviewer Is Interested In de- 
termining whether the applicant has Insight Into the following Issues relative 
* , to nursing: 

a* ' Demonstrates an Interest In the concept of job security related to nursing, 
b* Recognizes the need for continuing education In nursing, 
c. Recognises the need to relate theory to practice. 

d* Demonstrates awareness of psycho-social and socio-economic aspects of 
Illness and Its effect upbn patients. 

e. Appears Intellectually capable of understanding and accepting patients 
with chronic Illness* acutely 111 patients, dying patients, and death. 

f. Demonstrates recognition that the patient Is an Intricate part of the 
4 family unit and that the patient and family must be treated accordingly. 

g. Demonstrates awareness that patients need to be educated In terms of 
family health care ^nd maintenance ^ 

h. Is able to see the nurse as a potential change agent In Improving overall 
health care. 

Specific Interview questions might Include: 
' ^ a. How Joes It happen that you are now thinking about becoming a nurse? 

Who Influenced you? 

b. What Initially peaked your Interest In nursing? * 

c. What have you done to find out about the ac^vltles and role of a nurse?*^ 

d. What do you think nurses should do In their role as ^^health care prac- 

♦ 

tltloner besides administering physical care to patients? 

e. What have you done to Investigate other career possibilities? 

f 

f • What do you think you might dislike about being a nurse and how would 
you deal with ,thl8? o ' 
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Under what circumstances have you seen nurses In "action?" 
\ h« Has ai^one encouraged you In this choice or discouraged you? 

1. 2. _____ 3. . 4. . 5. 



Well below Below average Average Above average Well above 

average average 

2. Stamina 

While this concept relates to motivation. It refers more specifically to the 
applicant's q^apacity for endurance over an extended period of time and his 
tolerance for stress. In shorty has the applicant demonstrated that they can 
work longer than others and not only complete the ta^k but complete It well? 
Can the applicant physically endure the rigors of a seemingly impossible 
schedule? Questions appropriate to this construct might Include: 

a« What has been the most difficult Job you have ever undertaken?. Why 

was it difficult? 

b. In starting a Job that is difficult to finish » l^ow do you handle it? 
If it does not get finished » why? 

c* How would you compare your energy with that of most of your friends? 

d. In dealing with a stressful situation how do you handle anxiousness and 
the tendency to retreat? * 

e. How might shift work Interfere with your personal or family adjustment? 

1. ^ ' 2. 3. 4. 5. 



Well below Below average Average Above average . Well above 

average average 

A. ^ 
3. I^ersipnal Integrity and Maturity 

« 

This area is an attempt tu learn whether the applicant has the capacity for 
self-directed and self-motivated behavior. For example, is the applicant 
patient I profit from experience and demonstrate emotional stability, a sense 
of responsibility, an absence of^ anxiety and/or dej)resslon, good physical health, 
J excitement about learning and growing while remaining mentally alert in order to 

r render independent Judgments. In short, this is an attempt to determine whether 
the applicant has the capacity to function in a healthy, well Integrated and goal 
directed way consistent with the applicant's age. Questions would Include the 
following: 

a* What has motivated you to study and i^ork? 
b* How do you spend your non-*scheduled time? 
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c. What do you plan to do If not accepted Into this program? 

"tl. Do you have a dream of what you would like to do and If so^ tell me 
about It. What have you done to make your dream come true? 

How do you respond Intellectually or emotionally when you come up 
against a complex problem with no immediate or apparent solution? 

f • What would you do if you completely disagreed with the plan of action 
of the person in charge of a project you may be wbrking on or working with? 

1. 2. 3.* ^ 4. 5. 

Well below Below average Average Above average Well above 

averagQ ^ average 

4. S elf Insif^ht and Self Concept 

This is an attempt to identify whether the applicants have realistic insight about 
themselves* and their subjective and objective feelings about self'-like or dislike. 
For example^ can the, applicant praise their capabilities in a straightforward man- 
ner and also recognize their shortcomings and deal with negati><4| comments that 
might stem from these deficits* Questions in this area also relate to the indi- 
viduals ability to look at their own feelings honestly, accept responsibility^ for 
their own behavior, remain accountable for their own behaVior» utilize and accept 
feedback whether positive or negative, recognize the^t own limitations, and recog^ 
nize the consequences of their own actions. Questions would include the following: 



a. What do you consider your strong points and abilities?- 
b« What do you consider your weak points and abilities? How might you 
proceed to overcome them? 

c«\^What qualities you possess that seem especially suited to health care? 

d. Have you considered other health care careers? What? (This is an 
opportunity to, perhaps, provide the applicant with some useful information as 
well as to find out how realistic the applicant is about their interest and 
abilities). 

e. How do you feel you stack-up against most people you come in contact 

with? 

f . Are there some/ bosses and/oV teachers you have come in contact with 
who were not qualified? 
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g. Upon entering a new Interpersonal situation what do you expect to happen? 

h. How do you feel you have done In life so far? 

1. Do you feel you have ^ lot of friends? If yes» why? If no^ why? 



1^ ' 2. 3. . 4. • 5. 



Well below Below average Average ' Above average Well above ; 

Average - ' average 

5. " Interpersonal Competency 

In this content area thg Interviewer Is seeking Information on the applicants 
Interpersonal skills. Do they enjoy working with people? Are they relaxed In 
the Interview situation? Hew anxious were they to end the Interview? One Is 
Interested In the applicant's ability to work with people^ manifest open and 
% positive attitudes, remain sensitive, and relate to people- ofvarlous backgrounds. 
Applicants must show a basic Interest In people, possess a basic congenial per- 
sonality and good sense of humor, and demonstrate an ability to take Instructions. 
Questions In this area might Include the following: 

a. What qualities do you look for in a friend? 

b. Tell me about any experiences you have had meeting w^th people different 
from you in terms of age, race, religion, handicaps, etc? What did you learn 
from these experiences? 

c. What do you do when you find yourself disagreeing with other members of 
the group you are assigned to? 

d. What kind of activities do you pursue by yourself in your free time? In 
a group? * 

e. What would you do if you were in charge of a group- project and the other 
members threatened to quit? 

f. Do you like to be "in charge" of activities or do you prefer to just go 
along? 

g. Tell me about your friends,^ what they are like, what you do together. 

h. What sort of student is the most popular at' your school or what kind of 
person is most popular^ in your work? Are you that kind of person? If not, 

to what extent has this bothered you? What have you done to make yourself feel 
more at ease at your school or job? 

o 6 1) 
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Well below Below average^ Average Above average Well above 

average cx average 

6. Problem Solving Skills 

This is an^attempt to determine how well the applicant deals abstractly in t6rms 
of finding solutions to difficult problems. Questions here would provide information 
as to an applicant's ability to integrate and synthesize informatiqn from a variety 
of sources, remain flexible in the process of problem solving. Efforts should be 
made to question the applicant along such lines as; ' '^-^ 

_^ • 

a. How can quality health care be provided for the disadvantaged? Appli- 
cants should consider the problem that good policy .does not always get put itito 
good priactice. 

b. Given one oxygen; tank and two patients needing oxygen, one^of them Is 
younger, the other an older established member of the communit)^^ who gets the 
oxygen? (The issue here is not whether the applicant comes up with the proper ' 
solution but the process the applicant goes through* in obtaining a solution). 

c. If you had a difficult problem to solve at school or In your Job and 
after a considerable time no solution Is achieved through normal routine 'pro- 
cedures^ would you suggest an alternative course or stay within the same program? 

dk If your car stalled and you had to get somewhere for an important Irppoint- 
ment (test, Job interview), what would you do? 

e. What complex problems have you solved and how did you go about it? 

a 

1. 2. 3. ' 4. 5. 



Well below Below average Average Above average Well above 

average average 



7. Social Conscience and Empathy 



Included here are such concepts as dedication and compassion, the ability to be 
empathic, caring and affectionate to people, and the ability to demonstrate the 
appropriate effect, desire and wiillingness to help others^ In addition, thia is 
an attempt to determine whether the applicant understands current social problems 
iand is* committed to help in solving them. In short, does the applicant have a 
compassionate if not idealistic attitude towards his fellow man which extends 
beyond his own economic gain^ Questions in this area would include the following: 

a. How does poverty affect health care in this country? S 
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S b. What might be done to improve the health care of lower income groups /) 
in this country I why do you think the poverty cycle continues? ' 

c. Is it f^ir for there to be more than one Standard of medical care in 
this country? Why? 

d. Does everyone in this country have the right to the same quality of 
health care? 

e. How do you feel about more women and minority groups students being 
admitted to the professional schools? ^ 

i. How do you feel about individuals who are physically ill? 

g. How do you feel about individuals who are mentally ill? 

h. Is it more important to provide good medical care at th6 Expense of 
^emotional support or does emotional support play a role? 

1. 2. ' 3. 4. 5. 



Well below Below average Average Above average Well above 

average average 



8. Ethics 

This is an attempt to ascertain the applicant's internal standards which have 
^ developed in the course of growing up* Areas which are of interest here include 

trustworthiness » the capacity for truthfulness oven in reporting ones own orroro, 
care in handling da^geroao drugs » keeping patient^and fatsily infutmation confi- 
dential > and coming to terms with ethical issues such as abortion* Questions 
include: \ 

a. How do you feel about the number of lawyers involved in criminal 
activities in recent months? * Why? 

b. What need is there to be concerned about the ethical behavior of nurses? 

c. How does concern for the quality of life relate to the practice of jS^sing? 

d. Here is a hypothetical situation* You become aware of unp4hical practices 

on the part of physicians that you are associated with. What is your responsibility * 
to the nursing profession? • v 

e. Consider another hypothetical situation in which a female paeicift and/pr 
friend you know had been exposed to measles early inj) pregnancy and she io requesting 
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an^ afiortlioii* What would be your response? 

£• What ahould you do If you gave the patient the wrong medication and/or., 
dosage? 

^g* Do you feel that nurses have any special responsibility regarding the 
use of drugs Including alcohol? 

h« What responsibility does a laurses supervisor have if any, when she 
discovers that one of her nurses is cutting medical corners like taAng a' 
patient's vital signs ?n order to treat other patients? 

9. Communicating Skills 



This is an attempt to deteirmine whether an individual possesses the capacity for 
communicating either in writing or orally his ideas and skills. FurtEter* doos 
the applicant possess the capacity to listen to others » follow instructions, and 
%lsci4ss difficult Issues even though angry. Question^ would Include: 

a* Are you able to make a point even though angry? 

b. Can one learn more by listening attentively or responding orally? 

c. Do you correspond regularly with friends by letter^ phone, or in person? 

d. Do people have difficulty- accepting your explanations or can you usually 
convince them? 

^ e. Will people usually tell you what you want to know simply by asking 
straightforward questions or is the indirect ro,ute the most effective? 

f. Is quietness a sign of nervousness or simply shyness? 

g. In. the past have you had close frlenids that you shared secrets with? 

h. Can you condense InformaMon to a relevant point or two and understand 
what is being said? 

1. i 2. . 3. 4. r 5* 



Well below Below average Average Above average Well above 

average average 

10. Ability to Wo/k. With Hands 

Questions in thl.^conteat area stiould relate to job and/or j^chool experiences 
which have required manual dexterity including both* large and small muscle 
coordination* QuesWons Include: ^ 
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a. Uhat are your favorite sports and do you engage In them as a participant? 

b. Bo you ^gage in activities such asysewing^ mechanics^ music? If so» 
how wouldUyou rate yourjp skill? 

c. In worlclng around the house or job would you classify yourself as 
capable or clumsy In handling a number of task^ with virtual ease? 



1* 



2. 



3. 



Well below 
average 



4» 



5* 



Below average Average 



Above average Well above 
average 



11. Personal Appearance 



This Is a straightforward attempt to assesa^how well the applicants present 
themselves when under a stressful sltuatlm* The Interviewer should assess 
not only whether thjelr dress Is approprljrce but £ilso their grooming^ poise » 

and physical condijpon^ Consider If the applicant Is 
relaxed, nervous, cjutgolng, aggresslv>^^ Insistent on taking over the Interview, 
etc. 



1. 



2. 



3. 



4. 



5. 



Below average Average 



Well below 
average 



Recommended Decision, pleasS check one: 



Above average Well above 
average 



Unacceptatfle 
Possibly acceptable 
Probably acceptable 
Obviously acceptable. 
Outstanding 



Recommended ranking In terms of percentiles 
(Range from 1-100) 



Comments : 
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APPENDIX C 



CANDIDATE ^OFILE FORM USED BY 
NURSING STAFF INTERVIEWERS 
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FOBM: Nursing - Professional 



Student Name 



Date: 



CANDIDATE PROFILE 

Interviewer 



Rating 



Characteristic 



Well 
Avei 


Below 
rage 


Below 
Average 


Average 


Above 
Average 


Well Above 
Average 








2 


3 


4 


5 






2 


3 


, 4 


5 






2 


3 


4 


5 






2 


3 


4 


5 






2 


3 


4 


5 






2 


3 


4 


5 






2 


3 


4 


5 






\ ^ 


3 




5 






2 


3 

\ 


4 ' 


5 






2 


3 


4 


5 , 






2 


3 


4 


5 



1. Perception .of Nursing 



2. Stamina 



3. 



6. 



7. 



Personal integrity ^ 
Self insight and self concept 
Interpersonal competency 
Problem solving skills 
Social conscience and empathy 



8. Ethics 

9. Communicating skills, 

10. Ability to work with hands 

11. Personal appearance 

Total Score 



Percentile Ranking (Range from 1 - 100) 

Recommended Decision (Check One) : 

Unacceptable 

^Possibly acceptable 



Probably acceptable 
Obviously acceptable 
Outstanding 



Comments : 
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APPENDIX D 



INTERVIEWER OPINIONNAIRE 
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IMTERVIEWER EVALUATION OF IMTERVIEW INSTRUMENT AMD TRAINING TAPE 



Now that thm Interview process for the Nursing and Dental Hygiene Programs has 
been completed for this year» the Office of^ Institutional Research would like 
to begin an evaluation of the structured Interview Instrument, and the Interview 
training tape. As a Selection Committee Member » you can give valuable Input to - 
this evaluation by answering the questions on the attached sheet which pertain to 
your aspect of the Interview procedure. Please return the completed form to 
Diana Kelley by April 30. Thank you In advance for your help with this evaluation. 

1. Was 20 Routes sufficient time to satisfactorily complete the Interview? 
If not» please explain. 



2» Were the explanations for each of the characteristics to be assessed 
sufficient?^ If notp which specific explanations were Inadequate? 



3* Did the questions provided In the Instrument permit you to differentiate 

between applicants In terms of their potential for nursing or dental hygiene? 



4. Should the range of possible ratings be expanded from 5 (well below average » 
below average, average , above average, well above average) to some larger 
number? What do you suggest and why? 



If no, which 




should they be modified? 





Would the Interview Instrument be Improved by limiting the number of optional 
questions on each characteristic? Please explain. 



6. Would the Interview Instrument be Improved by requiring that each Interviewer 
ask the same question on each characteristic? Please explain. 



7. What one aspect of the structured Inteirvlew Instrmnent did you particularly 
Ilka? 



4 



8. What one aspect of the stxuctured Interview Instrument did you particularly 
dislike? What Improvements do you suggest? 



9. What was your overall Impression of the structured Interview Instrument? 



10. What Interview techniques would you add to the training tape? 



11. What asjpects of the training tape would you delete? 



12. How could the training tape be otherwise Improved? 
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